Remote control unit for a programmable multimedia controller

ABSTRACT

A remote control unit is provided that includes an annular touch sensor for manipulating an annular menuing system displayed on a display device. In response to a user gesturing by scrolling clockwise or counter-clockwise about the annular touch sensor, pressing firmly on the annular touch sensor, or tapping at a particular location on the annular touch sensor, the annular menuing system is manipulated to select particular items. The remote control unit is further configured to implement location-awareness features. Control is adapted to the location of the remote control unit and to the devices located nearby to this location. Similarly the remote control unit is further configured to implement user-awareness features, such that the control is adapted for the individual preferences of different users.

RELATED CASES

This application is related to the following United States PatentApplications:

Ser. No. 11/314,112 entitled, MULTIMEDIA CONTROLLER WITH PROGRAMMABLESERVICES, by Robert P. Madonna, et al., and

Ser. No. 11/314,664 entitled SYSTEM AND METHOD FOR A PROGRAMMABLEMULTIMEDIA CONTROLLER, by Robert P. Madonna, et al, the teachings ofboth of which are expressly incorporated by reference.

BACKGROUND OF THE DISCLOSURE

1. Field of the Disclosure

The present disclosure relates generally to device control, and moreparticularly to a remote control unit for a programmable multimediacontroller that controls a variety of electronic devices, such as audiodevices, video devices, telephony devices, data devices, securitydevices, motor-operated devices, relay-operated devices, Internetaccess/browser devices, general-purpose computers, handicap assistancedevices, and/or other types of devices.

2. Background Information

With the ever increasing complexity of electronic devices, simple yeteffective device control is becoming increasingly important. While onceelectronic devices could adequately be controlled with only a handful ofanalog knobs and switches, modern electronic devices often present userswith a vast array of configurable options and parameters, which requirecomplex controls to manipulate and select. In response to users' demandsfor “convenience,” these controls are often implemented on handheldremote control units, which use Infrared (IR), radio-frequency (RF), orother types of signals to interface with the electronic devices beingcontrolled. Yet actual convenience is seldom achieved with conventionalremote control units.

Users are typically burdened with having to manipulate a number ofseparate, device-specific remote control units, each of which typicallyimplements a different control scheme. Thus, to perform even basicfunctions, a user must have all the required remote control units onhand, and be familiar with how to manipulate each one. Further, the usermust understand how their devices are interconnected, so that they mayselect appropriate inputs for passing signals between the devices. Forexample, if a user desires to watch a DVD movie with the lights dimmedand a telephone ringer suppressed, he may have to operate threeAudio/Video (A/V) remote control units, one for a DVD player, one for atelevision, and one for an Audio/Video (A/V) receiver, as well as aremote control unit for a device controller, such as an X10™ lightingcontroller, in addition to manipulating a handset of a cordlesstelephone (in a sense, yet another remote control unit). Each of theseremote control units generally operates differently, and the user musttransition between several control schemes to perform the desiredfunctions. Further, the user must select the proper inputs for eachdevice, for example so that the video signals from the DVD player willmake their way through the A/V receiver for display on the television.

Many of the control schemes commonly employed with remote control unitsare non-intuitive and difficult to use. Most remote control units aredesigned with a button-centric paradigm, such that numerousfunction-specific buttons are crowded into a relatively small space onthe face of the remote control unit. The crowded button layout ofbutton-centric remote control units often makes it difficult to select adesired button from the many buttons available, especially in low-lightconditions. If a user inadvertently presses the “wrong” button, a devicemay perform an unwanted action or enter an undesired mode or state. Thismay confuse or aggravate the user. Further, sometimes a user may beuncertain which button to press in order to activate a desired function.In such a situation, the user may have to decipher abbreviated (oftencryptic) legends printed on, or about, the buttons of the remote controlunit. As these legends are often only a few characters long, a user mayhave to refer to a manual to determine what the legends mean, and whatfunctions are associated with each button. In short, many button-centricremote control units are far from intuitive and easy-to-use.

Furthermore, while a variety of so-called “universal” remote controlunits exist that claim to improve upon the shortcomings ofdevice-specific remote control units, conventional “universal” remotecontrols generally fall far short of their claims. Typical “universal”remote control units simply map the functionality of the buttons ofdevice-specific remote control units to buttons of the “universal”remote control. The underlying control schemes are generally notaltered. So, while the control schemes of the device specific remotecontrol units are all implemented on a single remote control unit, theyare not unified or simplified in any way. Further, since conventional“universal” remote control units attempt to control a range of devices,they typically have even more buttons with cryptic legends thandevice-specific remote controls. Thus, the problems of a button-centricparadigm are aggravated. Also, most “universal” remote control unitstend to be far from universal, as they typically do not operate withdevices other than audio and video devices. For example, conventional“universal” remote controls do not generally include functionality forcontrolling telephony devices, data devices, security devices,motor-operated devices, relay-operated devices, Internet access/browserdevices, general-purpose computers, handicap assistance devices, and/orother types of devices.

In addition, a variety of high-end touch-panel controllers exist thatpurport to improve upon device-specific remote control units. Forexample, Crestron Electronics, Inc. of Rockleigh, N.J. offers a line ofhigh-end touch-panel controllers that are widely available. Thesetouch-panel controllers incorporate central processor units, graphicscontrollers, I/O interfaces and other complex components similar tothose found in portable computers, rendering them complicated and costlyto manufacture. Further, such touch-screen controllers generally requireextensive custom programming to adapt to particular installations. Thus,their complexity and cost renders them unsuitable for many applications.

Furthermore, high-end touch-panel controllers, conventional “universal”remote control units, and device specific remote control units typicallylack any type of location-awareness, i.e. the ability to incorporateknowledge of the remote control unit's current location into the controlscheme, or user-awareness, i.e. the ability to incorporate knowledge ofthe remote control unit's current user into the control scheme. Thisburdens the user, requiring the user to make making all locationdependent decisions themselves and forgo the convenience ofuser-dependent control.

For example, considering the lack of location dependent control inconventional systems, suppose a user has several televisions in his orher home, and wishes to turn on a television located in the room inwhich he or she is sitting. With a conventional remote control unitcapable of controlling all the televisions, the user generally mustselect the particular television with a first button of the remotecontrol. The user must remember which button this is, or the remotecontrol unit must be labeled in some way. Only after the correcttelevision is selected, may the user select a second button to actuallyturn it on. A guest or other person unfamiliar with the remote controlunit, and its control scheme, may not know which television correspondswith which button. Thus, a simple action may become quite daunting, andrequire trial and error to execute.

As the number of devices controlled by a remote control unit grows, thedifficulties caused by a lack of location-awareness become even moreapparent. For example, suppose a user has configured lighting fixturesthroughout a home to be operable remotely using a device controller,such as an XI 0TM lighting controller. In such a configuration thelighting fixtures may readily be turned on and off with a remote controlunit. Yet using a conventional control scheme on the remote controlunit, a user would be required to select from a long list of availablelighting fixtures, often mapped to dozens of different buttons, tosimply turn on the fixture in the room he or she is entering. As isapparent, this would be quite burdensome to do each time one desires toturn on a light, and much of the convenience of remotely controlledlighting is lost.

Similarly, turning to the lack of user-dependent control in conventionalsystems, suppose several users each have their own individualpreferences relating to control schemes, for example, individualpreferences for certain options to be displayed, certain colors to beused, and/or other aesthetic or functional preferences. With aconventional system, even if a mechanism is provided to adjust theseparameters, the same adjustment will be shown to all users. A user whodesires to have his or her own personal control scheme is notaccommodated.

What is needed is an improved remote control unit that addresses theabove described shortcomings. Such a remote control unit should operatewith a programmable multimedia control for controlling andinterconnecting a variety of electronic devices, such as audio devices,video devices, telephony devices, data devices, security devices,motor-operated devices, relay-operated devices, Internet access/browserdevices, general-purpose computers, handicap assistance devices, and/orother types of devices.

SUMMARY OF THE DISCLOSURE

A remote control unit is provided for operating a programmablemultimedia controller, the remote control unit including an annulartouch sensor for manipulating an annular menuing system displayed on adisplay device. In one embodiment, the annular menuing system includes anumber of selectable options displayed as text or graphic icons. Inresponse to a user gesturing by scrolling clockwise or counter-clockwiseabout the annular touch sensor, pressing firmly on the annular touchsensor, or tapping at a particular location on the annular touch sensor,the selectable options rotate in the annular menuing system. A user mayfully direct their visual attention to the annular menuing system, asthe remote control unit may be manipulated from tactile sensation. Whenan option is brought to a designated position in the menuing system, itis selected by a further action of the user. In a second embodiment, theannular menuing system includes a number of regions displayed in anannular manner, and a selection cursor is disposed upon the menuingsystem. In response to a user gesturing on the annular touch sensor byscrolling clockwise or counter-clockwise, the selection cursor is movedin that direction on the annular menuing system. Alternately, bypressing firmly or tapping at a particular location on the annular touchsensor, a region located at a corresponding location of the annularmenuing system is selected. By selection of selectable options orregions, corresponding numerals, characters, text, devices, commands,Internet web pages, menus, or other options may be chosen. In thismanner, the combination of the annular menuing system and the remotecontrol unit with the annual sensor may replicate many of the functionsprovided by a mouse and keyboard, facilitating detailed control absentbulky input devices.

The remote control unit is further configured to implementlocation-awareness features. In one embodiment, a number oftransmitter/receiver units are dispersed throughout a structure wherethe programmable multimedia controller is located, for example theuser's home. Depending on the location of the remote control unit, asignal transmitted therefrom is received by one or more of thetransmitter/receiver units. Using the signal strength received at thetransmitter/receiver units, or alternately triangulation techniques orglobal positioning techniques, the location of the remote control unitis determined. Thereafter, control is adapted to this location, and tothe devices located nearby to this location. For example, the menuingsystem described above may be displayed on the display most proximate tothe location, as opposed to more distantly located displays. Similarly,when a user attempts to control a device, of which several are availableat different locations, the nearest device is automatically selected andcontrolled, absent explicit specification by the user. For example, ifseveral televisions are located in the structure, and the user selectsto turn on a television, the television most proximate to the remotecontrol unit will be activated, i.e. the television in the room in whichthe user is located. In such manner, the user is freed from explicitlyspecifying the device to be controlled where a particular device isdetermined (or assumed) to be the subject of the user's intentions.

Further, the remote control unit is configured to implementuser-awareness features. In one embodiment, a remote control unit isassociated with a particular user. When the user manipulates his or herremote control unit, a user profile is accessed and user-specificoptions applied to the control scheme. For example, a user may haveselected certain menu arrangements, colors, or styles that suit personalpreferences, and these will be displayed. Similarly, one user may haveaccess to certain devices or services controlled or offered by theprogrammable multimedia controller, while another user may not have suchaccess. In this manner, control options and access privileges may beunique to a particular remote control unit and thus to the user thatoperates that unit.

BRIEF DESCRIPTION OF THE DRAWINGS

This disclosure may be better understood by referring to the followingdescription in conjunction with the accompanying drawings in which likereference numerals indicate identical or functionally similar elements:

FIG. 1 is a block diagram of an illustrative programmable multimediacontroller, interconnected to a number of devices, which may be used inconjunction with the remote control unit disclosed herein;

FIG. 2 is a schematic block diagram showing a high-level hardwarearchitecture of the illustrative programmable multimedia controller;

FIG. 3A is a schematic diagram of an example annular touch sensor thatmay be incorporated into a remote control unit;

FIG. 3B is a schematic diagram of example switches and related circuitrythat may be used in conjunction with the annular touch sensor in aremote control unit;

FIG. 4 is a schematic diagram of an example remote control unit thatincorporates an annular touch sensor;

FIG. 5 is a diagram of a first example annular menuing system adapted tothe shape of the annular touch sensor of FIG. 3;

FIG. 6A is a diagram of a second example annular menuing system adaptedto the shape of the annular touch sensor of FIG. 3;

FIG. 6B is a diagram of an example linear menuing system that may becontrolled by gestures on the annular touch sensor of FIG. 3; and

FIG. 7 is a schematic diagram depicting an example technique forproviding location-awareness functionality to a remote control unit.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

FIG. 1 is a block diagram of an illustrative programmable multimediacontroller 100, interconnected to a number of devices, which may be usedin conjunction with the remote control unit disclosed herein. The term“programmable multimedia controller” should be interpreted broadly as adevice capable of controlling, switching data between, and/or otherwiseinteroperating with, a variety of electronic devices, such as audiodevices, video devices, telephony devices, data devices, securitydevices, motor-operated devices, relay-operated devices, Internetaccess/browser devices, general-purpose computers, handicap assistancedevices, and/or other types of devices. A programmable multimediacontroller may be configured to perform all these functions and workwith all these devices, or to perform a selected subset of functions andoperate with a selected subset of devices.

In the example of FIG. 1, the programmable multimedia controller 100 isconnected to a wide range of audio/video components, for example, acompact disk (CD) player 105, a digital video disc (DVD) player 110, anaudio/video receiver 115, a television 120, a personal media player 125,speakers 122, a microphone 123, and/or a video camera 124. Theprogrammable multimedia controller is also connected to telephonydevices such as a telephone network 130 and telephone handsets 132. Thetelephone network 130 may be a publicly switched telephone network(PSTN), an Integrated Services Digital Network (ISDN) or othercommunication network.

In addition, the programmable multimedia controller intercommunicateswith variety of lighting and/or home automation systems 135. Thesedevices may operate via the X10 protocol developed by Pico Electronics,the INSTEON™ protocol developed by SmartHome, Inc, the CEBus standardmanaged by the CEBus Industry Council, RS232, or another well knownautomation or control protocol. Similarly the controller is connected tomotor and/or relay operated devices 137 that may include, for example, aheating, ventilation and air conditioning (HVAC) system, an irrigationsystem, an automatic shade or blind system, an electronic door lock, orother types of devices.

A computer network, such as the Internet 140, is connected to theprogrammable multimedia controller. In addition, a personal computer(PC) 145, video game systems 150, home or studio recording equipment 165or other devices may also be connected. Further, one or more remotecontrol units 400 are provided to manage the controller's functionality,and/or to control devices connected to the controller. Details of theconfiguration of such remote control units may be found below,especially in relation to FIGS. 4-6. Each remote control unit may beinterconnected to the controller via a wired network connection or awireless connection such as an infra-red link, a radio-frequency link, aBluetooth™ link, a ZigBee™ link, WirelessUSB™, Certified Wireless USB,WI-FI, or another appropriate data connection. Further, each remotecontrol unit may be interconnect directly to the programmable multimediacontroller 100, or interconnected through one or more separatetransmitter/receiver units (not shown) that relay commands back to theprogrammable multimedia controller, and/or provide other functions.Further detail relating to such transmitter/receiver units is foundbelow in reference to FIG. 7.

In addition to providing interconnection to a wide variety of devices,the programmable multimedia controller is able to combine, synthesize,and otherwise processes various data types to implement an integratedmultimedia solution for a user. A detailed description of the variousnovel services and capabilities that may be provided is available inMULTIMEDIA CONTROLLER WITH PROGRAMMABLE SERVICES, by Robert P. Madonna,et al.

To facilitate the above described interconnections and processing, theprogrammable multimedia controller 100 may be arranged in a modularmanner. For example, in one embodiment, the programmable multimediacontroller 100 is arranged to have twelve separate input and outputmodules, each having a number of connection ports. The input and outputmodules are inserted into slots or module bays of the programmablemultimedia controller 100. The modules interface with a mid-plane thatprovides connection to the rest of the system. By embracing a modularapproach, a user is allowed to select the specific modules desired, andthe system may be customized to fit a particular application. Inaddition, entry level pricing may be reduced by allowing a user topurchase a base configuration, with limited capabilities, and then addto the system by purchasing addition modules. Several examples ofmodules are discussed in SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIACONTROLLER, by Robert P. Madonna, et al. It is expressly contemplatedthat a wide variety of additional modules may be provided. It is alsocontemplated that several programmable multimedia controllers may beinterconnected to create a larger system, in effect implementing amodular-type solution at the controller level. Further details regardingsuch interconnection and expansion may also be found in SYSTEM ANDMETHOD FOR A PROGRAMMABLE MULTIMEDIA CONTROLLER, by Robert P. Madonna,et al.

FIG. 2 is a schematic block diagram showing a high-level hardwarearchitecture of the illustrative programmable multimedia controller. Thevarious components shown may be arranged on a “motherboard” of thecontroller, or on a plurality of cards interconnected by a backplane(not shown). A microcontroller 210 manages the general operation of thesystem. The microcontroller 210 is coupled to an audio switch 215 and avideo switch 220 via a bus 218. The audio switch 215 and the videoswitch 220 are preferably crosspoint switches capable of switching anumber of connections simultaneously. However many other types ofswitches capable of switching digital signals may be employed, forexample Time Division Multiplexing (TDM) switches or other devices.

A mid plane 235 interconnects the switches to a variety of input andoutput modules such as, for example, Digital Video Input Modules withHDMI 290, Video Output Modules with HDMI 292, Digital Audio InputModules 294, and Digital Audio Output Modules 296. The mid plane 235 isfurther coupled to an Ethernet switch 230 that permits switching of10BaseT, 100BaseT or Gigabyte Ethernet signals. The Ethernet switch 230interconnects Ethernet ports 232 and a processing subsystem 240 to themicrocontroller 210. In one embodiment, the processing subsystem 240includes a plurality of small form factor general purpose personalcomputers that provide redundant operation and/or load balancing. Insome embodiments, the processing subsystem 240 may include one or morestorage devices, external to the personal computers, to provide expandedstorage capacity, for example, to store digital media.

Also, a number of Universal Serial Bus (USB) ports 242 areinterconnected to a USB hub 243 for interconnection to the processingsubsystem 240. A memory card interface 225 may also be connected to theUSB hub 243. The interface accepts one or more well-known memory cardformats, for example CompactFlash™ cards, Memory Stick™ cards, SecureDigital™ (SD) cards, or other formats. A USB switch 244 is employed toswitch USB links among the multiple processing components that may bepresent in the processing subsystem 240. In a similar manner, a numberof IEEE 1394 (FireWire™) ports 246 are interconnected to an IEEE 1394hub 247 and to an IEEE 1394 switch 248.

The microcontroller 210 is further connected to a Serial PeripheralInterface (SPI) and Inter-Integrated Circuit (I²C) distribution circuit250, which provides a serial communication interface to relatively lowdata transfer rate devices. The SPI/I²C controller 250 is connected tothe mid-plane connector 235 and thereby provides control commands fromthe microcontroller 210 to the modules and other devices in theprogrammable multimedia controller 100. Further connections from SPI/I²Ccontroller 250 are provided to devices such as a fan controller 251, atemperature sensor 252 and a power manager circuit 253, which manage thethermal characteristics of the system and prevent overheating.

The microcontroller 210 is also connected to Infra-Red (IR) interface260, an RS232 interface 265, and an RF interface 267, that permitinterconnection with external devices. Such interaction permitsprogrammable multimedia controller 100 to control external devices. Inaddition, the interfaces may receive control signals that control theoperation of the programmable multimedia controller itself. It isexpressly contemplated that various other interfaces, including WI-FL,Bluetooth™, ZigBee™, WirelessUSB™, Certified Wireless USB, and otherwired and wireless interfaces, may be used with the multimediacontroller 100.

In addition, an Auxiliary Audio/Video Port 298 is provided forinterconnecting one or more video game systems, camcorders, computers,karaoke machines, or other devices. A telephone interface 270 isprovided for connecting to the public switch telephone network or to aprivate network, and to connect to one or more telephone handsets.Further, a device control interface 275 is provided to communicate withlighting, home automation, and motor and/or relay operated devices. Asdiscussed in more detail below, an expansion port 280 is provided forlinking several programmable multimedia controllers together to form anexpanded system. Finally, a front panel display 285 permits presentationof status, configuration, and/or other information to a user. In oneembodiment the front panel display may accept video data originatingfrom any input source connected to the system, such that a user maypreview video content on the front panel display 285. In anotherembodiment, the front panel display 285 includes a touch sensitivescreen, and a user may enter control selections by selecting icons orother representations on the screen. In this manner the front paneldisplay 285 may be used for control and configuration of the system.

In addition to controlling the programmable multimedia controller 100using the front panel display 285, the programmable multimediacontroller 100 may be controlled by the one or more remote control units400, as is described in detail below.

FIG. 3A is a schematic diagram of an example annular touch sensor thatmay be incorporated into a remote control unit. Use of such an annulartouch sensor may obviate the need for many of the buttons found on aconventional button-centric remote control unit. While a variety ofannular touch sensors are commercially available, and techniques fortheir design and manufacture using force sensitive resistor (FSR)technology or capacitive sensing technology (for example CapSence™technology available from Cyress Semiconductor Co.) are well-known inthe art, the basic design of one type of touch sensor is describedherein to assist the reader. As used herein, the term “annular” shouldbe interpreted to refer to any possible ring-link shape into which atouch sensor may be formed, for example, a circular, elliptical,triangular, or polygonal shape. The term “annular” should also beinterpreted to encompass both closed shapes having a continuous path,for example a circle, and open shapes having a non-continuous path, forexample a U-shape with an open portion.

The example annular touch sensor operates according to potentiometricprinciples, thereby translating a user's gestures into electronicsignals. Referring to FIG. 3A, a bottom substrate 310 contains a finegrid of highly conductive traces that are supplied with voltage. Aflexible top substrate 330 is disposed above the bottom substrate 310and spaced there from by a spacer layer 320. The spacer layer 320 isthick enough to prevent the lower face of the top substrate 330 fromcontacting the bottom substrate 310 except when it is touched by a userand thereby deflected into contact with the bottom substrate 310. Thetop substrate 330 is conductive on its lower face and when brought intocontact with the grid of conductive traces on the bottom substrate 310,voltage is passed there-between. The voltage passed is generallyproportional to the location of the touch by the user. By varying whichtraces of the bottom substrate 310 are charged with voltage, and bytaking multiple measurements of the voltage transferred to the topsubstrate 330, information sufficient to decipher a user's gestures isobtained. This information is thereafter processed by a processor toprovide electrical signals descriptive of the user's gesture. Forexample, if a user touches and holds on the top substrate, slides toanother location, and then releases, the annular touch sensor 300 willcapture a series of voltage readings that are deciphered to yield thestarting location, path, speed, duration of travel, and ending locationof the user's gesture. Similarly, if a user simply lightly taps the topsubstrate at a particular location, the annular touch sensor capturesseries of voltage readings that are deciphered to yield the location,and duration of the tap.

FIG. 3B is a schematic diagram of example switches and related circuitrythat may be used in conjunction with the annular touch sensor in aremote control unit. In addition to detecting tapping and scrollinggestures, in some embodiments, a firm press upon the annular touchsensor is also detected and distinguished from a tap. Many users desiretactile feedback, and a firm press is accompanied by movement of theannular touch sensor 300, and in some configurations a reassuring“click.” To accomplish this, the annular touch sensor 300 is supportedabove a printed circuit board (PCB) 365 by a flexible molding, spring,or other means that permits the sensor to deflect or tilt in response toa firm press. A number of push button switches 342-354 are disposed inthe space between the PCB 356 and the annular touch sensor 300. Thesepush button switches may by membrane type switches, surface mountmechanical switches mounted to the PCB 356, or other known types ofswitches. In response to a firm press at a particular location upon theannular touch sensor 300, the annular touch sensor deflects or tilts sothat one or more of the switches are activated. Signals from theswitches are received by a microcontroller 360 (for example aprogrammable System-on-Chip (pSOC)), which is also configured to receivesignals from the annular touch sensor 300. The microcontroller 360debounces the signals and reconciles the signals from the switches andthe annular touch sensor 300 to generate commands. These commands aretransmitted to the programmable multimedia controller 100, andresponsive commands may be received back, using an RF Amplifier 370 andan RF Transceiver 380, or another type of interface 390, for example aninfra-red (IR) interface, a Bluetooth™ interface, a ZigBee™ interface, aWirelessUSB™ interface, a Certified Wireless USB interface, and/or aWI-FL interface.

FIG. 4 is a schematic diagram showing front, side and top views of anexample remote control unit 400 that incorporates an annular touchsensor 300. To address, in part, the shortcomings of a button-centricparadigm, the remote control unit 400 is configured to have a minimalnumber of buttons, e.g. 410, 420, 430 visible to the user. In oneembodiment, the buttons 410, 420, 430 are reserved for frequently usedfunctions, such as to activate a menuing system of the programmablemultimedia controller 100, or to return to a previous menu of such amenuing system. In another embodiment, the buttons are used for contextdependent input, such that, depending on the current operational stateof the programmable multimedia controller 100, the buttons havediffering functions. For example, if the programmable multimediacontroller 100 is currently controlling a television, a certain buttonmay control channel selection on the television. Likewise, if theprogrammable multimedia controller is currently being used to providetelephony services, the same button may perform a different function ofinitiating a telephone call.

Also located on the remote control unit 400, is an annular touch sensor300, which is the primary means for entry of user commands. In-oneembodiment, the annular touch sensor is used in conjunction with amenuing system presented by the programmable multimedia controller 100,to thereby control both the programmable multimedia controller anddevices interconnected thereto. The menuing system is driven by theprocessing power of the programmable multimedia controller 100, allowingthe remote control unit to possess minimal processing power itself, thusreducing complexity and cost of the controller compared to priorsystems.

The menuing system may be displayed on any of a variety of displaydevices interconnected to the programmable multimedia controller 100,such as televisions 120, computer monitors, desktop displays,touch-screens, or other types of display devices. In some embodiments,the menuing system is displayed on the front panel display 285 of theprogrammable multimedia controller itself, while in other embodiments,the remote control unit 400 includes a display screen for display of themenuing system. Hereinafter, any display device on which the menuingsystem may be displayed will be referred to simply as a “menuing capabledisplay,” and such term should be interpreted broadly to encompass allof the above discussed alternatives, and variations thereof.

Each menuing capable display may display the menuing system on theentire display, i.e. as a full-screen menuing system, or may show themenuing system as an overlay upon a portion of video or still images,i.e. as a partial-screen menuing system. One technique for overlaying amenuing system (or other graphics or text) upon video or still images isdisclosed in SYSTEM AND METHOD FOR A PROGRAMMABLE MULTIMEDIA CONTROLLER,by Robert P. Madonna, et al., and the reader is referred thereto forfurther details. While the technique disclosed therein may be used toadvantage with the present disclosure, it is expressly contemplated thatother techniques may alternately be employed.

During normal operation, a user may focus their attention upon themenuing system on the menuing capable display, and control the remotecontrol unit 400 largely through tactile sensation. In oneconfiguration, the remote control unit 400 is designed to rest mostcomfortably at a particular orientation in the user's hand, such thatthe buttons and annular touch sensor 300 are always at particularpositions with respect to the user's fingers. For example, the roughlycone shaped remote control unit 400 of FIG. 4 fits naturally in a user'shand with the user's palm and fingers wrapped around the circumferenceof the cone, and the user's thumb resting on the top of the cone, withthe top of the cone inclining away from the user. As the remote controlunit is generally always oriented in the same manner when operated, theuser may operate the remote largely without looking thereto.

FIG. 5 is a diagram of a first example annular menuing system 500adapted to the shape of the annular touch sensor 300 of FIG. 3. Such amenuing system may be displayed on any menuing capable displayobservable to the user. The menuing system 500 is composed of aplurality of selectable options 510, 520, 530, 540 displayed in anannular configuration. While only four selectable options are shown inFIG. 5, any number of selectable options may be provided. The annularmenuing system may be two-dimensional, with the selectable options 510,520, 530, 540 arranged in a plane parallel to display screen, or may bethree-dimensional, such that the selectable options 510, 520, 530, 540are arranged in an annular pattern in three-dimensional space, and animage of the three-dimensional space is displayed to the user.Similarly, the selectable options themselves 510, 520, 530, 540 may betwo or three-dimensional representations. In one embodiment, theselectable options 510, 520, 530, 540 are graphic icons, whoseappearances are related to, or otherwise associated with, theirrespective functions. For example, the selectable options 510, 520, 530,540 may be graphic icons representing the devices controlled by theprogrammable multimedia controller 100, and their selection may be usedto indicate one of the devices for further control. Similarly theselectable options 510, 520, 530, 540 may be graphic icons related toInternet web pages, and their selection may be used to navigate to thosewebpages. In another embodiment, the selectable options are textcharacters, such as words, or individual numerals or letters. In such anembodiment, the annular menuing system may be used to input a number,such as a channel number or telephone number, or a text string, such asa name, a postal address, or a URL of a webpage. In this manner, theremote control unit may be used to replace a conventional keyboard andmouse for input and text entry.

To select the different selectable options 510, 520, 530, 540, a usergestures with the annular touch sensor 300 of the remote control unit400. In one embodiment, the user gestures by scrolling with his or herfinger clockwise or counter-clockwise about the annular touch sensor300. In response thereto, the selectable options 510, 520, 530, 540rotate on the menuing capable display. For example, referring to FIG. 5,selectable option 520 may rotate into the position now-occupied byselectable option 510, in response to a clock-wise gesture by the user.In some embodiments, the rate of rotation of the selectable options isrelated to the rate of the user's scrolling on the annular touch sensor300. This may permit fine grain control of the menuing system.

A user may select a selectable option 510, 520, 530, 540 by bringing theoption to a designated location in the annular menuing system 500, forexample to the foreground location of a three-dimensional annularmenuing system, or the bottom location of a two-dimensional annularmenuing system. Once at the designated location, the user selects theselectable option by releasing his or her finger from the annular touchsensor 300, pressing firmly on the annular touch sensor, tapping theannular touch sensor, pressing a button, and/or by performing anotherrecognized action.

In another embodiment, rather than rotating a selectable option to adesignated location in the menuing system 500, the user selects aparticular selectable option by gesturing, for example pressing firmlyor tapping, at a particular position on the annular touch sensor 300. Bygesturing at a position that corresponds to the position of theselectable option in the menuing system 500, the particular selectableoption is chosen. For example, referring to FIG. 5, where fourselectable options are shown oriented in four quadrants, if the usergestures on the right hand portion of the annular touch sensor 300, therightmost selectable option 520 is selected.

FIG. 6A is a diagram of a second example annular menuing system 600adapted to the shape of the annular touch sensor 300 of FIG. 3. Such anannular menuing system may be advantageous for use with numeral input,and such an adaptation is pictured in FIG. 6A. Numerals 0 through 9 areeach displayed in separate regions 610-655. In one embodiment, a movableselection cursor 670 is disposed on the menuing system. In response to auser gesturing on the annular touch sensor 300, by scrolling clockwiseor counter-clockwise, the selection cursor 670 is moved clockwise orcounter-clockwise about the annular menuing system 600. Once theselection cursor is located over the desired region 610-655, the userselects the region, and its associated numeral, by releasing the annulartouch sensor, pressing firmly on the annular touch sensor, tapping theannular touch sensor, or otherwise indicating selection.

In an alternate embodiment, rather than manipulate a selection cursor670, a user selects a region by gesturing, for example by pressingfirmly or tapping, at a particular position on the annular touch sensor300. In response thereto, the region, and the associated numeral, of themenuing system 600 whose position corresponds to that position isselected. For example, referring to FIG. 6A, if the user taps at thevery top of the annular touch sensor 300, the region 640, and therebynumeral 6, in the corresponding position on the menuing system 600 isselected.

Numerals input by the menuing system 600 may be used in a variety ofmanners by the programmable multimedia controller 100. For example, thenumerals may be used to enter channel numbers for television viewing, toinput telephone numbers for telephony functions, or to interact withonline purchasing services. A fuller listing of possible functions andservices with which numeral entry may be used is found in MULTIMEDIACONTROLLER WITH PROGRAMMABLE SERVICES, by Robert P. Madonna, et al., andthe reader is referred thereto for greater detail.

Further, while the above description discusses selection of numeralswith the menuing system 600, the menuing system may readily be adaptedfor other types of input, such as character input, with letters assignedto each region; string input, with several characters (i.e. words)assigned to each region; or device selection, with device icons or namesassociated with each region. As such, the description of the menuingsystem 600 should be interpreted broadly and not be limited toparticular type of input or selection.

Also, while annular menuing systems are described above, it should beremembered that the menuing system need not be annular in allconfigurations. FIG. 6B is a diagram of an example linear menuing system601 that may be controlled by gestures on the annular touch sensor 300.While the example in FIG. 6B is adapted for numeral input, with regions611-656 associated with the numerals 0-9, such a linear menuing system601 may readily be used to facilitate character input, with letters A-Zeach associated with each region, or alternately string input or controlinput. A selection cursor 671 is disposed upon the linear menuing system601. In response to the user gestures by scrolling with his or herfinger clockwise or counter-clockwise about the annular touch sensor300, the selection cursor 671 is moved rightwards or leftwards. That is,annular movement on the annular touch sensor 300 is translated to linearmovement of the selection cursor 671 in the linear menuing system 601.Once the selection cursor 671 is located over the desired region611-656, the user selects the region, by releasing the annular touchsensor, pressing firmly on the annular touch sensor, tapping the annulartouch sensor, or otherwise indicating selection.

Furthermore, while several menuing systems have been described hereinfor use with the annular touch sensor 300, it should be remembered thata menuing system need not always be employed with the sensor. In oneembodiment, rather than being used to manipulate a menuing system,gestures on the annular touch sensor 300 have predefined meanings, apartfrom any menuing system. By entering a particular gesture, an associatedcommand is triggered. For example, if a television is currently beingcontrolled by the programmable multimedia controller 100, pressingfirmly or tapping on the upper or lower portions of the annular touchsensor is interpreted to increment or decrement the channel number shownon the television. Similarly, pressing firmly or tapping on theleft-side or right-side portions of the annular touch sensor isinterpreted to raise or lower the volume of the television. In anotherembodiment, if a video camera is currently being controlled by theprogrammable multimedia controller 100, gesturing by scrolling clockwiseor counter-clockwise on the annular touch sensor 300 is interpreted topan the video camera left or right. In this manner, the annular touchsensor may be used with a variety of control functions absent a menuingsystem.

In addition to employing an annular touch sensor 300, the example remotecontrol unit 400, is configured to implement location-awarenessfeatures. FIG. 7 is a schematic diagram depicting an example techniquefor providing location-awareness to the remote control unit 400. Anumber of transmitter/receiver units 710, 720, 730 are dispersedthroughout a structure where the programmable multimedia controller 100is located, for example the user's home. The units 710, 720, 730 may belocated on separate floors, in separate rooms, or even in differentportions of the same room depending upon the desired level oflocation-awareness. Each transmitter/receiver unit is connected back tothe programmable multimedia controller 100 by a wired connection, suchas an Ethernet cable providing Power over Ethernet (PoE) service, or bya wireless connection, for example a WI-FL connection. Further, eachtransmitter/receiver unit 710, 720, 730, as well as the programmablemultimedia control 100 itself, implements a wireless interface forcommunicating with the remote control unit 400. The wireless interfacemay be any of a variety of known interfaces, for example an infra-red(IR) interface, a radio-frequency (RF) interface, a Bluetooth™interface, a ZigBee™ interface, a WirelessUSB™ interface, a CertifiedWireless USB interface, and/or a WI-FI interface.

Depending on the location of the remote control unit 400, a signaltransmitted there from is received by one or more transmitter/receiverunits 710, 720, 730 and/or the programmable multimedia controller 100itself. According to one embodiment, if the signal is received by onlyone device, the location of that device is associated with the remotecontrol unit 400. If the signal is received by several devices, thesignal strength at each device is measured and compared, and thelocation of the device that detects the strongest signal is associatedwith the remote control unit 400. For example, if the signal transmittedby the remote control unit 400 is received by two transmitter/receiverunits 720, 730 as well as the programmable multimedia control 100, and aparticular transmitter/receiver unit 720 detects the greatest signalstrength, the remote control unit 400 is associated with location ofthat transmitter/receiver unit 720.

According to another embodiment, rather than measure signal strength,the devices employ triangulation techniques to determine a location ofthe remote control unit 400 with respect to the transmitter/receiverunits 710, 720, 730. By employing triangulation techniques a limitednumber of transmitter/receivers may be used, while a very preciselocation for the remote control unit provided.

In yet another embodiment, global positioning techniques may be employedwith the remote control unit 400. The remote control unit 400 mayinclude a global positioning system (GPS) receiver that determines aprecise location from received GPS signals. This location is thentransmitted from the remote control unit 400 to the programmablemultimedia controller 100.

Once the location of the remote control unit 400 is determined, theprogrammable multimedia controller 100 adapts control functions inaccord with the devices that are proximate to that location. In oneembodiment, a menuing system is displayed on the menuing capable displaymost proximate to the location of the remote control unit. For example,suppose a first television (not shown) that is connected to theprogrammable multimedia controller 100 is located proximate to a firsttransmitter/receiver unit 710 and a second television (not shown) thatis connected to the programmable multimedia controller 100 is locatedproximate to a second transmitter/receiver unit 720, and remote controlunit is located near the second transmitter/receiver unit 720. Inresponse to the user manipulating the remote control unit 400, a menuingsystem may be automatically displayed on the second television, absentany user specification of that display. Suppose also that, at some latertime, the user leaves the location, i.e. walks to another room, and theremote control unit 400 comes to be located near the firsttransmitter/receiver unit 710. The programmable multimedia controller100 is configured to recognize this change, and in response thereto, nowdisplay the menuing system on the first television that is nearby thefirst transmitter/receiver unit 710.

In addition to providing location-awareness features, eachtransmitter/receiver unit itself may implement control features. In oneembodiment, a transmitter/receiver unit includes a plurality of buttonsand/or an annular touch sensor. These buttons and annular touch sensoroperate to control the programmable multimedia control in a similar ismanner to the buttons and touch sensor on the remote control unit. Thusa user is given an option of using a remote control unit, or atransmitter/receiver unit to input control choices.

In another embodiment, the particular device activated or controlled byan action on the remote control unit 400 depends on the location of theremote control unit. For example, suppose a user enters a command on theremote control unit to turn on a television for viewing. If the user islocated most proximate to the second television, the second televisionmay be activated without explicit user specification. Alternately, ifthe user is located nearby the first television, that television may beactivated instead. In such manner, the user is freed from explicitlyselecting a television, and such selection instead is made by theprogrammable multimedia controller 100 in response to locationinformation and assumptions regarding typical user activities. If theassumptions made by the programmable multimedia controller prove to beincorrect, the user may always override the selection and explicitlyspecify the device to be controlled according to well known techniques.

In a further example, location-awareness may be applied to the area oflighting control. Suppose a number of lighting fixtures are controlledby a lighting controller (not shown) interconnected to the programmablemultimedia controller 100 and a button on the remote control unit 400 ismapped to a “light switch” function, to activate or deactivate lightingfixtures. Depending on the location of the remote control unit 400,light fixtures proximate to the location are controlled by the button,i.e. the lights in that room turned on or off. If a user walks toanother location, i.e. to another room, the lights therein will becontrolled by the button absent explicit specification of the newlighting fixtures or of the new room entered.

While the above embodiments discuss televisions and lighting fixtures,location-aware control may be readily applied to any of the devicescontrolled by the programmable multimedia controller. Accordingly, it isexpressly contemplated that a variety of audio, video, telephony, data,security, motor-operated, relay-operated, and/or other types of devicesmay be controlled in response to location information.

Further, while the above described techniques discuss determining thelocation of the remote control unit with transmitter/receiver units 710,720, 730, alternately, the location of the remote control unit 400 maybe determined in another manner. For example, each remote control unitmay be configured to include a Radio Frequency Identification (RFID)transponder, and a number of RFID scanners (not shown) dispersed atdifferent locations. Upon entering a new location, the user may move theremote control unit into proximity of the RFID scanner to record theremote control unit's location. In another alternative, the remotecontrol unit 400 may be physically coupled, i.e. docked, with a baseunit at a particular location. In response thereto, the location of theremote control unit may be determined by the base unit to which it iscoupled.

In addition to location-aware control, in another embodiment each remotecontrol unit is configured provide user-aware control. A number ofremote control units are provided for use with the programmablemultimedia controller, each associated with a particular user. When auser manipulates his or her particular remote control unit, a userprofile is accessed and user-specific options applied to the controlscheme. For example, a user may have selected certain menu arrangementsand styles that suit particular preferences. These arrangements andstyles are displayed when the user manipulates his or her particularremote control unit. Similarly, a user may have access to certaindevices or services controlled or offered by the programmable multimediacontroller, while another user may not. For example, a user who is ayoung child may not have access to certain channel which may containadult content, or to certain configuration options where the systemsfunction may be changed in an unwanted manner, while a user who is anadult may have complete control. In this manner different users, throughuse of their particular remote control units, may have different controlprivileges.

The foregoing description has been directed to particular embodiments ofthis disclosure. It will be apparent, however, that other variations andmodifications may be made to the described embodiments, with theattainment of some or all of their advantages. While the abovedescriptions mainly discuss a remote control unit connected via awireless interface, a wired interface may alternately be employed. Inone embodiment, this wired interface may take the form of a Power overEthernet (PoE) interface to the programmable multimedia controller, suchthat in addition to the interchange of control information, power may besupplied by the interface. Further, while the above descriptions discussthe remote control unit working with a programmable multimediacontroller, the remote control unit may alternately be configured workwith just a conventional general purpose computer and attached displayscreen. In such a configuration, the remote control unit may be used tocontrol the general purpose computer's functions through a menuingsystem displayed on the computer's monitor. For example, a user may usethe remote control unit and menuing system to control an Internetbrowsing function of the computer to interaction with online services.

Additionally, the procedures or processes described above may beimplemented in hardware, software, embodied as a computer-readablemedium having program instructions, firmware, or a combination thereof.Therefore, it is the object of the appended claims to cover all suchvariations and modifications as come within the true spirit and scope ofthe invention.

1. A system for controlling devices coupled to a programmable multimediacontroller: a remote control unit having an annular touch sensor, theannular touch sensor responsive to gestures there upon by a user; adisplay device coupled to the programmable multimedia controller; and anannular menuing system configured to be displayed upon the displaydevice, the annular menuing system having a number of selectable optionsarranged in an annular configuration, the annular menuing systemconfigured to, in response to a gesture by the user, rotate theselectable options to bring a particular selectable option to adesignated position in the annular menuing system, to permit selectionof the particular selectable option; wherein the programmable multimediacontroller is configured to execute an action in response to selectionof the particular selectable option.
 2. The system of claim 1 whereinthe annular touch sensor of the remote control unit is supported by aflexible member that permits the annular touch sensor to deflect inresponse to a press by the user, and the remote control unit furthercomprises a plurality of push button switches disposed beneath theannular touch sensor, wherein deflection of the annular touch sensoractivates one or more of the push button switches.
 3. The system ofclaim 2 wherein the annular menuing system is further configured toselect the particular selectable option in response to activation of oneor more of the push button switches.
 4. The system of claim 1 whereinthe remote control unit further comprises a button arranged on a face ofthe remote control unit, the button operable by the user, and whereinthe annular menuing system is further configured to select theparticular selectable option in response to operation of the button. 5.The system of claim 1 wherein the annular menuing system is furtherconfigured to select the particular selectable option in response to theuser releasing from contact with the annular sensor.
 6. The system ofclaim 1 wherein each of the selectable options is a graphic icon.
 7. Thesystem of claim 6 wherein at least some of the selectable optionsrepresent devices coupled to the programmable multimedia controller andthe action is to designate a particular device to be controlled.
 8. Thesystem of claim 6 wherein each of the selectable options represents anInternet webpage and the action is to display a particular webpage. 9.The system of claim 1 wherein each of the selectable options isassociated with a text character and the action is to provide the textcharacter associated with the particular selectable option to a devicecoupled to the programmable multimedia controller.
 10. The system ofclaim 1 wherein each of the selectable options is associated with anumeral and the action is to provide the numeral associated with theparticular selectable option to a device coupled to the programmablemultimedia controller.
 11. The system of claim 10 wherein theprogrammable multimedia controller is configured to control atelevision, and the provided numeral is received by the television andused as a channel number.
 12. The system of claim 1 wherein the displaydevice is a television.
 13. The system of claim 1 wherein the annularmenuing system is overlaid upon a selected portion of video images beingdisplayed on the display device.
 14. A system for controlling devicescoupled to a programmable multimedia controller comprising: a remotecontrol unit communicating with the programmable multimedia controllervia a wireless connection, the remote control unit having an annulartouch sensor, the annular touch sensor responsive to gestures there uponby a user; a display device used by the programmable multimediacontroller; and a menuing system configured to be displayed upon thedisplay device, the menuing system having a number of selectableoptions, a selection cursor of the menuing system configured to, inresponse to a gesture by the user on the annular sensor, move about theselectable options to designate a particular selectable option; whereinthe programmable multimedia controller is configured to issue one ormore commands to a device coupled to the programmable multimediacontroller in response to selection of the particular selectable option.15. The system of claim 14 wherein each of the selectable options isassociated with a channel number and the one or more commands providethe channel number.
 16. A method for controlling devices coupled to aprogrammable multimedia controller comprising: displaying an annularmenuing system on a display device coupled to the programmablemultimedia controller, the annular menuing system having a number ofselectable options, receiving a gesture from a user on an annular touchsensor of a remote control unit, the remote control unit communicatingwith the programmable multimedia controller via a wireless connection;in response to the gesture from the user, moving the selectable optionsto bring a particular selectable option to a designated position in themenuing system, to permit selection of the particular selectable option;in response to selection of the particular selectable option, executingan action.
 17. The method of claim 16 wherein the menuing system is anannular menuing system with selectable options arranged in an annularconfiguration.
 18. The method of claim 16 wherein at least some of theselectable options represent devices coupled to the programmablemultimedia controller and the action is to designate a particular deviceto be controlled.
 19. A system for controlling devices coupled to aprogrammable multimedia controller comprising: a remote control unitresponsive to input by a user; a plurality of transmitter/receiver unitsdispersed in various locations in a structure in which the programmablemultimedia controller is located, the transmitter/receiver units coupledto the programmable multimedia controller, each of thetransmitter/receiver units having a wireless interface for wirelesslycommunicating with the remote control unit, the transmitter/receiverunits configured to determine a location of the remote control unitwithin the structure; and the programmable multimedia controllerconfigured to automatically select one or more devices in response tothe determined location of the remote control unit and to control theone or more devices in response to input on the remote control unit. 20.The system of claim 19 wherein each transmitter/receiver unit isconfigured to measure a signal strength of a wireless signal from theremote control unit, the signal strength to be used to determine thelocation of the remote control unit within the structure.
 21. The systemof clam 20 wherein the location of the transmitter/receiver unit thatmeasures the strongest signal strength is used as the location of theremote control unit.
 22. The system of claim 19 wherein at least some ofthe transmiffer/receiver units triangulate the location of the remotecontrol unit.
 23. The system of claim 19 wherein the one or more devicescomprise menuing capable displays, and the programmable multimediacontroller is further configured to cause a first menuing capabledisplay located more proximate to the determined location of the remotecontrol unit than a second menuing capable display to display a menuingsystem having a number of selectable options.
 24. The system of claim 19wherein the one or more devices comprise lighting fixtures, and theprogrammable multimedia controller is further configured to activate afirst lighting fixture located more proximate to the determined locationof the remote control unit than a second lighting fixture.
 25. A methodfor controlling devices coupled to a programmable multimedia controllercomprising: receiving user input on a remote control unit, the remotecontrol unit communicating via a wireless interface with a plurality oftransmitter/receiver units dispersed in varitous locations in astructure in which the programmable multimedia controller is located;determining the location of the remote control unit; in response to thedetermined location of the remote control unit, selecting, by theprogrammable multimedia controller, a first device located moreproximate to the determined location of the remote control unit than asecond device; and providing a command to the first device to controlthe first device.